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Abstract —We study the problem of routing in sensor networks 
where the goal is to maximize the network’s lifetime. Previous 
work has considered this problem for fixed-topology networks. 
Here, we add mobility to the source node, which requires a 
new definition of the network lifetime. In particnlar, we redefine 
lifetime to be the time until the source node depletes its energy. 
When the mobile node’s trajectory is unknown in advance, we 
formulate three versions of an optimal control problem aiming at 
this lifetime maximization. We show that in all cases, the solntion 
can be reduced to a sequence of Non-Linear Programming (NLP) 
problems solved on line as the source node trajectory evolves and 
include simulation examples to illustrate our results. When the 
mobile node’s trajectory is known in advance, we formulate an 
optimal control problem which, in this case, reqnires an explicit 
off-line nnmerical solution. 


I. Introduction 

A Wireless Sensor Network (WSN) is a spatially distributed 
wireless network consisting of low-cost autonomous nodes 
which are mainly battery powered and have sensing and wire¬ 
less communication capabilities HI. Applications range from 
exploration, surveillance, and target tracking, to environmental 
monitoring (e.g., pollution prevention, agriculture). Power 
management is a key issue in WSNs, since it directly impacts 
their performance and their lifetime in the likely absence of 
human intervention for most applications of interest. Since the 
majority of power consumption is due to the radio component 
m, nodes usually rely on short-range communication and 
form a multi-hop network to deliver information to a base 
station. Routing schemes in WSNs aim to deliver data from the 
data sources (nodes with sensing capabilities) to a data sink 
(typically, a base station) in an energy-efficient and reliable 
way. The problem of routing in WSNs with the goal of 
optimizing performance metrics that reflect the limited energy 
resources of the network has been widely studied for static 
(i.e., fixed topology) networks 0,0,0,161,117]. In recent 
years, mobility in WSNs has been increasingly introduced 
and studied 0,0 and ITOl with the aim of enhancing their 
capabilities. In fact, as discussed in HD, mobility can affect 
different aspects of WSN design, including connectivity, cost, 
reliability and energy efficiency. There are various ways to ex¬ 
ploit WSN mobility and incorporating it into different network 
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components. For instance, in 0 sink mobility is exploited 
and a Linear Programming (LP) formulation is proposed for 
maximizing the network lifetime by finding the optimal sink 
node movement and sojourn time at different nodes in the 
network. In ITOl mobile nodes (mules) are used to deliver data 
to the base station. WSNs with partial mobility are studied in 
HD- As discussed in HU, there exist two modes for sensor 
nodes mobility: weak mobility, forced by the death of some 
sensor nodes and strong mobility using an external agent 

ni,H5i. 

In this paper, we focus on the lifetime maximization prob¬ 
lem in WSNs when source nodes are mobile. This situation 
frequently arises when a mobile sensor node is used to 
track one or more mobile targets or when there is a large 
area to be monitored that far exceeds the range of one or 
more static sensors. In the case of a fully static network 
the lifetime maximization problem was studied in 0 and 
0 by defining the WSN lifetime as the time until the first 
node depletes its energy. Since it is often the case that an 
optimal policy controlling a static WSN’s resources leads to 
individual node lifetimes being the same or almost the same 
as those of others, this definition is a good characterization of 
the overall network’s lifetime in practice. In 0 routing was 
formulated as an optimal control problem with controllable 
routing probabilities over network links and it was shown that 
in a fixed network topology there exists an optimal policy 
consisting of time-invariant routing probabilities. Moreover, 
the optimal control problem may be converted into the LP 
formulation used in @. It is worth mentioning that a routing 
policy based on probabilities can easily be implemented by 
transforming these probabilities to packet flows over links and 
using simple mechanisms to ensure that flows are maintained 
over time. In El the simplifying assumption of idealized 
batteries used as energy sources for nodes was also relaxed and 
a more elaborate model was used to capture nonlinear dynamic 
phenomena that are known to occur in non-ideal batteries. A 
somewhat surprising result was that again an optimal policy 
exists which consists of time-invariant routing probabilities 
and that in fact this property is independent of the parameters 
of the battery model. However, this attractive property for 
routing is limited to a fixed network topology. 

Adding mobility to nodes raises several questions. First, 
one can no longer expect that a routing policy would be time 
invariant. Second, it is no longer reasonable to define the WSN 
lifetime in terms of the the first node depleting its energy. For 
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instance, if a source node travels far from some relay nodes it 
was originally using, it is likely that it should no longer rely 
on them for delivering data to the base station. In this scenario, 
the network remains “alive” even when these nodes die. Thus, 
in view of node mobility, we need to revisit the dehnition of 
network lifetime. Finally, if a routing policy is time-varying, 
then it has to be re-evaluated sufficiently fast to accommodate 
the real-time operation of a WSN. 

In the sequel, we consider mobility added to the source 
node and assume that any such node travels along a trajectory 
that it determines and which may or may not be known in 
advance. We limit ourselves to a single source node (the case 
of multiple mobile source nodes depends on the exact setting 
and is not addressed in this paper). While on its trajectory, the 
source node continuously performs sensing tasks and generates 
data. Our goal is to derive an optimal routing scheme in order 
to maximize the network lifetime, appropriately redefined to 
focus on the mobile source node. Assuming hrst that the 
source node trajectory is not known in advance, we formulate 
three optimal control problems with differences in their ter¬ 
minal costs and terminal constraints and investigate how they 
compare in terms of the optimal routing policy obtained, total 
energy consumption, and the actual network lifetime. We will 
also limit ourselves to ideal battery dynamics for all nodes. 
However, adopting non-ideal battery models as in ifThll does 
not change our analysis and only complicates the solution 
computation. We then consider the more challenging (from a 
computational perspective) problem where the source node’s 
trajectory is known in advance, in which case this information 
can be incorporated into an optimal lifetime maximization 
policy. 

In Section [III we define the network model and the energy 
consumption model is presented in Section |III] In Section 
HVl we formulate the maximum lifetime optimization problem 
for a WSN with a mobile source node whose trajectory is 
not known in advance. Starting with a new dehnition for the 
network lifetime, we show that the solution is a sequence of 
Non-Linear Programming (NLP) problems along the source 
node trajectory. Numerical examples are included to illustrate 
our analytical results. In Section|V] we consider the case when 
the source node trajectory is known in advance and show that 
its solution leads to a Two Point Boundary Value Problem 
(TPBVP). 

IT Network model 

Consider a network with N+1 nodes where 0 and N denote 
the source and destination (base station) nodes respectively. 
Nodes 1,..., iV — 1 act as relay nodes to deliver data packets 
from the source node to the base station. We assume the 
source node is mobile and travels along a trajectory with a 
constant velocity while generating data packets which need to 
be transferred to the hxed base through static relay nodes. 
First, we assume the trajectory is not known in advance. 
Then, we discuss the case when the trajectory is known in 
Section lYl Except for the base station whose energy supply 
is not constrained, a limited amount of energy is available to 
all other nodes. Let ri{t) be the residual energy of node i, 
i = 0,... ,iV — 1, at time t. The dynamics of ri(t) depend 
on the battery model used at node i. Here, we assume ideal 


battery dynamics in which energy is depleted linearly with 
respect to the node’s load, i.e., 

r,{t) = -I{t) (1) 

The distance between nodes i and j at time t is denoted 
by dij{t). Since the source node is mobile, doj{t) is time- 
varying for all j = 1, ..., N — 1. However, dij{t) = dij, i = 
1,...,A^ — 1, j = 2, ...,7V are treated as time-invariant with 
the assumption that the source node cannot be used as a relay, 
i.e., any node i > 0 must transfer data to other relay nodes 
j > 0, j ^ i or directly to the base station node N. The 
source node can send data packets to any of the relay nodes 
as well as to the base station, while relay nodes can trans¬ 
mit/receive data packets to/from nodes in their transmission 
range. Let 0{i) and I{i) denote the set of nodes to/from 
which node i can send/receive data packets respectively. Then, 
0{i) = {j ■ dij < Ti} and I{i) = {j : dj^i < tj} where 
Ti, i = 1,N — 1 denotes the transmission range of node 
i. We dehne Wij{t) to be the routing probability of a packet 
from node i to node j at time t (equivalently, a data flow from 
i to j) and the vector w{t) = [wij{t)Y defines the control in 
our problem. Let us also define r{t) = ...,r 7 v-i(f)] as 

the vector of residual energies at time t. For simplicity, the 
data sending rate of source node 0 is normalized to 1 and 
let Gi{w) denote the data packet inflow rate to node i. Given 
these definitions, we can express Gi (w) through the following 
flow conservation equations: 

Gi{w) = ^ Wki{t)Gk{w), i = Go(w) = 1 


HI. Energy Consumption Model 

In our WSN environment, the battery workload I(t) is due 
to three factors: the energy needed to sense a bit, Egense, the 
energy needed to receive a bit, Erx, and the energy needed 
to transmit a bit, Etx- If the distance between two nodes is d, 
we have: Etx = p{d), Erx = Cr, E sense = Ge, where Cr, 
Ge are given constants dependent on the communication and 
sensing characteristics of nodes, and p{d) > 0 is a function 
monotonically increasing in d; the most common such function 
is p{d) = Cf + Ggd^ where C/, Gg are given constants and 
/3 is a constant dependent on the medium involved. We will 
use the common situation where /3 = 2 in the rest of the 
paper, but this has no effect on our approach. We shall use 
this energy model, but ignore the sensing energy Cg, i.e., 
set Ge = 0 (otherwise, Ge is simply added to the source 
node’s workload without affecting the analysis). Clearly, this 
is a relatively simple energy model that does not take into 
consideration the channel quality or the Shannon capacity of 
each wireless channel. The ensuing optimal control analysis 
is not critically dependent on the exact form of the energy 
consumption model attributed to communication, although the 
ultimate optimal value of w{t) obviously is. Eor any node 
( = 1 ,..., — 1 , the workload Ii{t) at that node is given by 

I^iwit)) = G,iw{t))[ Y, w^Jit)iCsdl^{t) + Cf) + Gr] (3) 
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and the workload Io{t) at the source node 0 (recalling that 
Go{w{t)) = 1) is given by 

Ioiwit))= woj{t)iC,dl^{t)+Cf) (4) 

jeo(o) 

Assuming an ideal battery behavior for all nodes as in ([T]i, the 
state variables for our problem are ri(t), i = 0,...,7V — 1. 
Note that doj{t) = ||(a;o(f), j/o(f)) — {xj,yj)\\, the Euclidean 
distance of the source node from any other node is known at 
any time instant t (but not in advance) as determined by the 
source node’s trajectory. Finally, observe that by controlling 
the routing probabilities Wij{t) in (IHi and Q we directly 
control node i’s battery discharge process. 

IV. Optimal control problem formulation 

Our objective is to maximize the WSN lifetime by con¬ 
trolling the routing probabilities For a static network, 

where all nodes including the source node are fixed, the 
network lifetime is usually defined as the time until the 
first node depletes its battery M, 0. However, when the 
source node is mobile, this definition of network lifetime is 
no longer appropriate as explained in Section I. In the sequel, 
we formulate three optimal control problems for maximizing 
lifetime in a WSN with a mobile source node and investigate 
their relative effect in terms of an optimal routing policy, total 
energy consumption, and the network lifetime. 

A. Optimal Control Problem - I 

We define the network lifetime as the time when the source 
node runs out of energy. Consider a fixed time t when the 
source node is at position (a;o(f), t/o(f)) C In the absence 
of any future information regarding the position of this node 
(e.g., the node may actually stop for some time interval before 
moving again), the routing problem we face is one of a fixed 
topology WSN similar to the one in El but with different 
terminal state constraints due to the new network lifetime def¬ 
inition. Thus, this maximum lifetime optimal control problem 
is formulated as follows, using the variables defined in dD, Q 
and (IHi: 

r 

min — dt (5) 

’«(*) Jo 

s.t. ri{t) =ri{0) = Ri, i = 0,..,N-l (6) 

R(w(t)) = G,iwit))[ Y, w,At)iCsdlj + Gf) + a], 

j€0(i) 

i = l,...,N-l (7) 

Ioiw{t))= Y 'Woj{t)iGsdl^{t)+Gf) (8) 

jeo(o) 

do,jit) = ||(a;o(f),J/o(i)) - {xj,yj)\l xo{t),yoit) given 
Giiwit)) = Y ^ki{t)Gkiwit)), i = l,..,N -I (9) 

kGl(i) 

Wijit) = 1, 0 < Wijit) <1, i = 0,..., N — 1 (10) 

jeOi 

roiT)=0 (11) 

ro{t) > 0, t e [0,T); ri(t) >0, i = - 1, t e [0,r] 

( 12 ) 


where ri(t), i = 0,...,N — 1, are the state variables repre¬ 
senting the node i battery dynamics and (a;o(f), j/o(f)) 
the given instantaneous coordinates of the source node at 
time t. Control constraints are specified through (fTOl l. Finally, 
([n]l provides the boundary conditions for ro{t) at t = T 
requiring that the terminal time is the time when the source 
node depletes its energy. In what follows, we will use w*{t) 
to denote the optimal routing vector at the fixed time t. 


1) Optimal control problem I solution: We begin with the 
Hamiltonian for this optimal control problem: 

Hix, xo,yo, w, A, t) = -1 -f Ao(f)(-/o(f))+ 


N-l 

Y Ut)i-m) (13) 


i=l 

where Ai(f) is the costate corresponding to ri{t), i = 
0,N — 1 and must satisfy: 


A*(f) = -^ = 0 i = 0,...,N-l (14) 

Therefore, Ai, i = 0,...,N — 1, are constants. To determine 
their values we make use of the boundary conditions which 
follow from (HU, i.e., the terminal state constraint function is 
$(r(T)) = vroiT) and the costate boundary conditions are 
given by: 


A.(T) 


a$(ro(T),...,rAf-i(r)) 

dr,{T) 


i = 0,...,A^-l 


which implies that 


Ai=0 i = 1, Ao = i^ 


(15) 


where u is some scalar constant. Finally, the optimal solution 
must satisfy the transversality condition HiT)-\- = 

0, i.e., —1 + vro{T) + vfoiT) = 0, which yields: v = 
l/2fo(T) < 0, where the inequality follows from (fTTT l and 
(fTU which imply that fo{T) < 0 and consequently i/ < 0. 


Theorem 1: There exists a time-invariant solution of (|5]i- 

([11: w*it)=w*iT), t e [0,T]. 


Proof: Observe that the control variables Wijit) appear 
in the problem formulation (H- dn only through hiwit)). 
Applying the Pontryagin minimum principle to ([TU : 




-(jv-i(0] = arg min 

/i>0; i=0,...,Af-l 




and making use of the fact that we found Ai = 0, i = 
1, ...,N - 1, we have: /^(f) = argmin/„(t)>o(-l - vioit))- 
Recalling that i/ < 0, in order to minimize the Hamiltonian, 
we need to minimize Io{t). Therefore, the optimal control 
problem dU-dH is reduced to the following optimization 
problem which we refer to as Pl(f): 


min/o(f) (16) 

w{t) 


s.t. Iiiw{t)) = Giiw{t))[ Y xoijit)iGsdlj + Gf) + Gr], 

jeOii) 


(17) 

Io{wit))= Y w,jit){Gsdl^it)^ + Gf) (18) 
ieO(o) 

do,jit) = \\ixoit),yoit)) - ixj,yj)\\, xoit),yoit) given 

Giiwit)) = Y^ '^hiit)Ghiw), i = -1 (19) 
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Wtj{t) = l, 0 <Wij{t) <l,i = 0,..,N -1 (20) 

h{t)dt = Ro (21) 

When t = T, the solution of this problem is w*{T) and 
depends only on the fixed network topology and the values 
of the fixed energy parameters in ( fTSl l and the control variable 
constraints (|20] |. The same applies to any other t € [0,T), 
therefore, there exists a time-invariant optimal control policy 
w*{t) = w*{T), which minimizes the Hamiltonian and proves 
the theorem. ■ 

As the trajectory of the source node evolves, let us dis¬ 
cretize it using a constant time step 6. Thus, at time in¬ 
stants t,t + 5,... ,t + k6, ... we solve problems Pl(f + kS), 
k = 0, 1 ,... based on the associated source node positions 
{xo{t+k6), yo{t+k6)), fc = 0, 1 ,... as they become available. 
Theorem 1 asserts that at each time step, there exists a fixed 
optimal routing vector w*{t + kS) = wl associated with the 
source node’s position. Thus, an optimal routing vector at each 
time step is obtained by solving the following NLP; 

min y] + (22) 

i6O''(0) 



s.t. 


E 


= 1 , 


0 < wfj < 1, i = 0, 


,N-1 (23) 


where is a routing vector at step k, 0^{i) is the set of 
output nodes of i (which may have changed since some relay 
nodes may have died), and = ||(x§,t/Q) — {xj,yj)\\ is the 
distance between the source node and node j at the fcth step. 
Observe that in (|2^ the objective value is minimized over 


w, 


Of 


j € 0^(0) leaving the remaining routing probabilities 
'Wij, i = 1, j € 0^{i), subject only to the feasibility 

constraints (|2^ . Therefore, at each iteration, the source node 
sends data packets to its nearest neighbors in 0^(0) in order 
to minimize its load. The remaining routing probabilities need 
to be feasible according to ( l23b . The simplest such feasible 
solution is obtained by sending the inflow data packets to the 

neighbors of a relay node uniformly, i.e., = , i = 

1,..., W — 1. Finally, at the end of each iteration we update 
the residual energy of all nodes as follows: 

(24) 

If < 0 we declare the network to be dead. However, if 
fc+l 


<0, i = 1,.., W — 1, then we omit dead nodes and 
update the network topology to calculate in the next 

iteration with one fewer node. Note that it is possible for all 
relay nodes to be dead while > 0, implying that the 

source node still has the opportunity to transmit data directly 
to the base if W € 

The fact that the solution of P 1(f) does not allow any direct 
control over the relay nodes is a drawback of this formulation 
and motivates the next definition of WSN lifetime. 


B. Optimal Control Problem - II 

As already mentioned, the optimization problem (l22Tl - (l2^ 
does not directly control the way relay nodes consume their 
energy. To impose such control on their energy consumption, 
we add ^ terminal cost to the objective 


function of the optimal control problem (fSTl- dT^ and formulate 
a new problem as follows: 


min 

w{t) 


dt 


N-l 

^E 

2 = 1 


n{T) s.t. ® - (na) (25) 


where e > 0 is a weight reflecting the importance of the total 
residual energy relative to the lifetime as measured at time 
t. Thus, in order to minimize the terminal cost, relay nodes 
are compelled to drive their residual energy to be as close to 
zero as possible at t = T. This plays a role as we solve the 
sequence of problems resulting for the source node movement; 
the inclusion of this terminal cost tends to preserve some relay 
node energy which may become important in subsequent time 
steps. The solution of (l25T l obviously results in a different 
network lifetime T* relative to that of problem (l5ll- (fTa i. which 
is recovered when e = 0. 


1) Optimal control problem II solution: The Hamiltonian 
based on the new objective function (l25l l. as well as the costate 
equations, are the same as (fOT l and (fT4l i respectively. However, 
the terminal state constraint is now 

N-l 

^r{T)) = eJ2n{T) + uro{T) 

2=1 

and the costate boundary conditions are given by: 
a$(ro(T),...,rAr-i(r)) 


A,(T) = 




dxi (T) 

so that Xi = e, i = — 1 Xq = i/. Finally, the 

transversality condition H{T) + d^/dl\t=T ~ ^ for this 
problem is 

N-l N-l 

-1 -f vfo{T) + e ri{T) + iyro(T) + e i\{T) = 0 
2=1 2=1 

resulting in 




< 0 


(26) 


2roiT) 

Looking at and (fT2t and as already discussed in the 
previous section, we have fo(T) < 0. For the any relay node 
i = 1,N — 1, there are two possible cases: (i) Node i is not 
transmitting any data at t = T, i.e., the node is already out of 
energy or the inflow rate to that node is zero, Gi{w{T)) = 0. 
In this case, Ii{T) = 0, consequently fi(T) = 0. (ii) Node i 
is transmitting, i.e., Ii{T) > 0, therefore, ri{T) < 0. It follows 
that — 0 and we conclude that v < 0. 

Theorem 2: There exists a time-invariant solution of (l25T i: 

W*{t) = w*{T), t e [0,T]. 


Proof: The proof is similar to that of Theorem 1. First, 
observe that the control variables Wij (t) appear in the problem 
formulation (l25l l only through Ii{w{t)). Next, applying the 
Pontryagin minimum principle to (HI and based on our 
analysis we get; 

iV-l 

= arg min [-1 - - e J] f{t)] 

2=1 

(27) 

Recalling that i/ < 0 in (|26]) . in order to minimize 
the routing vector should minimize Ia{f) while maximizing 
e Therefore, the optimal control problem (l25T l can 
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be written as the following problem P2(f): 

N-l 

min {Io{t) + - y /,(t)) s.t. (dll) - (El]) (28) 

i—1 

where < 0 is an unknown constant which must also be 
determined (if ly — 0, the problem in (l27l) reduces to maxi¬ 
mizing separately solved). Using the 

same argument as in Theorem 1, at t = T, the solution w*{T) 
depends only on the hxed network topology and the values of 
the fixed energy parameters in (fTsT i and the control variable 
constraints (fT7l i- (l20l i. The same applies to any other t € [0, T), 
therefore, there exists a time-invariant optimal control policy 
w*{t) = w*{T), which minimizes the Hamiltonian and proves 
the theorem. ■ 

The intuition behind P2(f) in (l28T l is that one can prolong 
the network lifetime by minimizing the load of the source 
node while maximizing the workload of relay nodes. As in 
the case of Pl(f), we proceed by discretizing the source node 
trajectory and determining at step k an optimal routing vector 
wl and associated by solving the NLP; 

min (Io{w’^) + y | s.t. and (29) 

■ujk^jjk I i/k: j 

/,(u>'=) = G,(«;'=)[ y wk{Csdl^+Cf) + Cr] (30) 

io{w'^)= y y(a«,-)2 + G/) (31) 

^£0*^(0) 

G,(u;'=)= Y. ^h^Gh{w'^), i = l,...,N-l (32) 

hGl^(i) 

y y = i, o<y < 1 , i = o,..., 7 v-i ( 33 ) 

jGO'={i) 

We then evaluate the energy level of all nodes using (l24ll and 
check the terminal constraint (fTTl l at the end of each iteration. 
If the source node is “alive”, we update the network topology 
to eliminate any relay nodes that may have depleted their 
energy in the current time step. Note that in order to solve (|2^ - 
(l3^ we also need to determine so that it satisfies (|2^ with 
f*(r) = = —Ii{wl). To do so, we start with an 

initial value and iteratively update it until (l26T l is satisfied. This 
extra step adds to the problem’s computational complexity and 
motivates yet another definition of WSN lifetime. 


C. Optimal Control Problem - III 

In this section, we revise the terminal constraint used in 
Problem I in order to improve the total energy consumption 
in the network and possibly reduce the computational effort 
required in P2(f) due to the presence of v in (l28T l. Thus, 
let us replace the terminal constraint (fTTT l. i.e., ro{T) = 0, 
by ri{T) = 0, thus redefining the WSN lifetime as 

the time when all nodes deplete their energy. Compared to 
Problem II where we included ^ constraint 

on the total residual relay node energy, here we impose it as 
a hard constraint. The following result asserts that the source 
node 0 must still die at t = T, just as in Problem I. 

Lemma 1: Consider (jSjl-lO with (fTTIi - (fT^ replaced by 
= Then, fo(r) < 0. 


Proof: Proceeding by contradiction, suppose fo(T) = 0, 
consequently ro(fi) = 0 for some ti < T and there must exist 
some node * > 0 such that ri{ti) > 0 otherwise the network 
would be dead at ti < T. Then, woj{ti) = 0. This implies 
that Gj{w{ti)) = 0 for all j G 0(0), i.e., there is no inflow 
to process at any node j G 0(0), therefore, Gi(w(ti)) = 0 at 
all nodes i > 0 contradicting the fact that ri(ti) > 0 for some 
i > 0. ■ 

1) Optimal control problem III solution: We apply the new 
terminal constraint to problem (BTl- lfT^ . i.e., replace (fTT]) - (fT^ 
by 

N-l 

y n{T) = 0 (34) 


The Hamiltonian is still the same as (HI and the costate 
equations remain as in (Ell. However, the terminal state 
constraint, as well as the costate boundary conditions, are 
modihed as follows: 

N-l 

$(r(T)) = z/ y r,(T) (35) 

2 = 0 


A.(T) 


a$(ro(T),...,rAz_i(r)) 

dn{T) 


= V, 


= 0,...,W-1 
(36) 


Thus, the costates over all t G [0, T] are identical constants, 
Xo(t) = ... = = V. Similar to our previous analysis, 

we use the transversality condition H(T) + = 

0 to investigate the sign of i/: —1 + ^to^^^G(T’) + 

G{T) = 0 and we get i/ = < 0 by 

examining all possible cases for the state of relay nodes at 
f = T as we did for (l26l) . Finally, applying the Pontryagin 
minimum principle leads to the following optimization prob¬ 
lem P3(f); 

N-l 

min y Ii{t) s.t. (fT7|l — (l20ll and (37) 


N — 1 N—\ 

y / = y i?, ( 38 ) 

i=0 •^0 i=0 

This new formulation indicates that the optimal routing vec¬ 
tor corresponds to a policy minimizing the overall network 
workload during its lifetime, T. We can once again establish 
the fact that there exists a time-invariant solution of dSll- 
w*{t) = w*{T), t G [0,T] with similar arguments 
as in Theorems 1 and 2, so we omit this proof. We then 
proceed as before by discretizing the source node trajectory 
and determining at step k an optimal routing vector by 
solving the NLP; 

Af-l 

min y Ii{w^) s.t. (1501) — (1551) (39) 

i=0 

Note that problem ([39) is not always feasible. In fact, its 
feasibility depends on the initial energies of the nodes (0) = 
Ri, i = 0,..,N — 1, in (|6). It was shown in llTbll that, 
for a fixed network topology, if we can optimally allocate 
initial energies to all nodes, this results in all nodes dying 
simultaneously, which is exactly what (l34l) requires. However, 
such degree of freedom does not exist in ( l39) , therefore, one 
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or more instances of (l39l l for k = 0,1,... is likely to lead 
to an infeasible NLP problem since we cannot control 
Clearly, this makes the definition of WSN lifetime through (l34] | 
undesirable. Nonetheless, we follow up on it for the following 
reason: We will show next that ( |39] |. if feasible, is equivalent 
to a shortest path problem and this makes it extremely efficient 
for on-line solution at each time step along the source node 
trajectory. Thus, if we adopt a shortest path routing policy at 
every step k, even though it is no longer guaranteed that this 
solves <39]) since (l34l i may not be satished for the values of 
Rf at this step, we can still update all node residual energies 
through (|6ll and check whether < 0. The network is 

declared dead as soon as this condition is satished, even 
if > f*- Although (l34l l is not satished at the 

kth step, this approach provides a computationally efficient 
heuristic for maximizing the WSN lifetime over the source 
node trajectory in the sense that when < 0 at time t + k5, 
the lifetime is T = t -\- k5 and this may compare favorably 
to the solution obtained through the Problem II formulation 
where both lifetimes satisfy ro(T) = 0 with r^iT) < 0 (by 
Lemma 1). This idea is tested in Section HV-DI 

2) Transformation of Problem III to a shortest path prob¬ 
lem: The WSN can be modeled as a directed graph from the 
source (node 0) to a destination (node TV). Each arc {i,j) is 
a transmission link from node i to node j. The weight of arc 
{i,j) is dehned as Qij = Cr + Cs ■ df j Cf which is the 
energy consumption to transmit one bit of information from 
node i to node j. A path from the source to the destination 
node is denoted by p with an associated cost dehned as 
Cp = j)epQij- Clearly, for each bit of information, the 
total energy cost to deliver it from the source node to the base 
station through path p is Cp. 

Theorem 3: If problem ( |39] | is feasible, then its solution is 
equivalent to the shortest path on the graph weighted by the 
transmission energy costs Qij for each arc 

Proof: We hrst prove that if the solution of ( |39] | includes 
multiple paths from node QtoN where nodes in the path have 
positive residual energy, then the paths have the same cost. 
We proceed using a contradiction argument. Suppose that in 
the optimal solution there exist two distinct paths and P2 
such that Cp* < Cp*. Let qp* and qp* be the amounts of 
information transmitted through Pi and P2 respectively in a 
time step of length 6, i.e., qp* -f qp* = Gq ■ 5. 

In addition, let be the total amount of energy con¬ 
sumed under an optimal routing vector w'^ over the time 
step of length <5, i.e., ■ 5. It follows that 

qp*Cp* -f qp*Cp* = f^. Suppose we perturb the optimal 
solution so that an additional amount of data e > 0 is 
transmitted through P*. Then: 

(qp* -f e)Cp* -f {qp* - e)Cp* = fl + e{Cp* - Cp*) < rl 

This implies that J^i minimum cost and the 

original solution is not optimal, leading to a contradiction. 

We have thus established that if the solution of ( |39] | (if it 
exists) includes multiple paths from node 0 to where nodes 
in the path have positive residual energy, then the paths have 
the same cost. Recall that arc weights correspond to energy 
consumed, therefore the shortest path on the graph weighted 
by the transmission energy costs guarantees the lowest cost 


to deliver every bit of data from the source node to the base 
station, i.e., min^^p^■ 

D. Numerical examples 

In this section, we use a WSN example to compare the 
performance of different formulations based on the three 
different network lifetime definitions we have considered. We 
consider a 6-node network as shown in Fig. [1] Nodes 1 and 
6 are the source and base respectively, while the rest are 
relay nodes. Let us set Cs — 0.0001,(7/ = Cr = 0.05, and 
/3 = 2 in the energy model. We also set initial energies for 
the nodes Ri = 80, i = 1,...,5. Starting with the source 
node at (a:o(0), yo(0)) = (0,0), we solve the two optimization 
problems (l29ll-(l33Tl with e = 1 and the equivalent shortest path 
problem of (iJTl l for Problems II and III respectively as the 
trajectory of the source node evolves. Since this trajectory 
is not known in advance, in this example we assume the 
source node moves based on a random walk as shown in 
Fig. [1] We hrst hnd the optimal routing vector by solving 


Source node trajectory through network 


Location of 
node 1 at t=T 




O nodes 

* source node trajectory 


Fig. 1. Example 6-node network with mobile source (node 1) 


(I29ll- (l33t at each time step along the source node trajectory 
treating the network topology as hxed for that step. Fig. 
shows the routing vectors during the network lifetime, i.e., 
the time when the source node depletes its battery (in our 
numerical examples, we dehne this to be the time when the 
source node energy level reaches 10% of its initial energy). 
The evolution of residual energies of all nodes during the 


Routing Probabilities while source traveling 



Fig. 2. Optimal routing vector for the WSN in Fig. ^ with a mobile source 
node (Problem II) 
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network lifetime is shown in Fig. [3] We can see that at 
T = 184 the residual energy of the source node drops to 10% 
of its initial energy, hence that is the optimal lifetime obtained 
using the definition where the soft constraint 
included in (l25T l. Next, we use the WSN definition where 



Routing Probabilities while source traveling 
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Fig. 4. Optimal routing vectors for the WSN in Fig. [Jwith a mobile source 
node (Problem III) 


Fig. 3. Residual energies over time during the network lifetime 


= 0 is used as a hard constraint. As already 
discussed, the corresponding problems ( l39l l over the source 
node trajectory are generally infeasible. Instead, we adopt the 
shortest path routing policy at each step to exploit Theorem 3 
with the understanding that the result (for this particular WSN 
definition) is suboptimal. We consider the same source node 
trajectory as in Fig. [1] The optimal routing vector updates are 
shown in Fig. |4] while Fig. |3 shows the residual energy of 
the nodes during the network lifetime, which in this case is 
T = 188.49, slightly longer than the one obtained in Fig. [2 
with considerably less computational effort. Also, note that 
since the source node always sends data packets through the 
shortest path, it never uses nodes 2 and 4 for this particular 
trajectory. As expected, (IlTll-® is not feasible, however 
finding the shortest path at each step in fact improves the 
network lifetime in the sense of the first time when the source 
node depletes its energy. We point out, however, that this is 
not always the case and several additional numerical examples 
show that this depends on the actual trajectory relative to the 
relay node locations. 

Recall that e is the weight of the soft constraint in problem 
P2(f). Applying small or large e makes the problem closer to 
Pl(f) or P3(f) respectively, e.g. e = 0.5 results in T = 190, 
however e = 8 shrinks the lifetime to T — 156 suggesting 
that it is not optimal in this scenario to encourage the nodes 
to die simultaneously. Based on the numerical results, it is 
obvious that the definition of a static WSN lifetime is not 
appropriate here. Finally, we observe that the routing vectors 
are such that at each time step a subset of nodes is fully used 
{wij = 1) while the rest are not used at all. This suggests the 
possibility of a “bang-bang” type of optimal routing policy, 
which deserves further investigation. 

V. Optimal Control Formulation when source 

NODE TRAJECTORY IS KNOWN IN ADVANCE 

In this section, we consider the case when we have full 
advance knowledge of the source node trajectory and include 
this information in the optimal control problem. Defining the 
WSN lifetime to be the time when the source node depletes its 



Fig. 5. Residual energies over time during the network lifetime 


energy, i.e., using the definition in Problem I, Section IIV-AI 
the problem is formulated as follows; 

min — f dt (40) 

w{t) Jq 


s.t. n{t) = 


Xo{t) 





Ii{w{t)) = 


-h{w{t)), rM=R^. i = 0,..,W-l (41) 

fx{xo{t),yo{t)) 


fy{xoit),yoit)) 


(a:o(0),2/o(0)) given (42) 


G.{wm ^ w,,{t){Csdi + Cf) + a], 

jeo(i) 


i = l,...,N-l (43) 

Ioiwit))= wojmCsdl^{t) + Cf) (44) 
760 ( 0 ) 

Gi{w{t)) ^ WM{t)Gk{w{t)), i = l,..,N -I (45) 
kel{i) 

Wij (t) = 1, 0 < Wij (t) < l,i = 0,..., N — 1 (46) 

j&Oi 

ro{T) = 0 (47) 

ro(f) > 0, f e [0,r); ri{t) >0, 7 = 1,.., 1, f G [0,T] 

(48) 

where (l42l) specifies the trajectory of the source node. In 
this problem, the state variables are the residual node en¬ 
ergies, ri{t), as well as the source node location at time 
t, {xo{t),yQ{t)). Similar to Section IIV-AI we obtain the 
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Hamiltonian: 

N-l 

H{w, t, A) = —1 + Xo{t){—Io{t)) + + 

i=l 

Xxit)f^{xo{t),yo{t)) + Xy(t)fy{xo{t),yo{t)) (49) 

As before, Xi{t) is the costate corresponding to ri{t), i = 
0,1 and we add Xx{t), Xy{t) to be the costates of xo{t) 
and yo{t). Since we now know the equation of motion for the 
source node in advance, this imposes terminal constraints for 
the location of the source node at t = T. Thus, based on the 
dynamics in (l42l i we can specify xo(T) and yo(T) as xo{T) — 
Fxa{T) and yoiT) = Fyg{T). Therefore, the terminal state 
constraint is: 


$(r(r),a:o(T),yo(r)) = 
vr^iT) + yx{xo{T) - Fxo{T)) 


^^yiyoiT) - Fy^{T)) 


(50) 

where z/, y,x, and py are unknown constants. It is straightfor¬ 
ward to show that Xi{t), i = 1, ...,7V — 1 are as in (fTSl l. On 
the other hand, and Ay must satisfy: 


Xxit) = - 


dH 

dxn 


= 2C'sAo(f) ^ [wojit){xo{t) - Xj)] 
760 ( 0 ) 


dH 


(51) 


Kit) = = 2CsXo{t) [wojit){yo{t) - yj)] 


dyo 


760 ( 0 ) 


with boundary conditions: 

d^r{T),xoiT),yo{T)) 


XxiT) = 

KiT) = 


dxo{T) 

a$(r(r),ato(T),j/o(T)) 


dyoiT) 


— l^X 


— y-y 


(52) 


(53) 


(54) 




= 0 gives: 


The transversality condition H(T) H—— 

at 

- 1 + z^fo(T) + Xx{T)xo{T) + Xy{T)yo{T) + i'ro{T)+ 


t=T 


.,rr,_ dFx,{T) 


• frp\ _ dFyg{T) 

y-yi/oiT) yy 


, , , r~u . =0 (55) 

The solution of this problem is computationally challenging. 
Adjoining the control constraints (l46l l to the Hamiltonian, the 
problem can be numerically solved using a TPBVP solver, 
which, fortunately, can be done off line in advance of the 
source node initiating its known trajectory. It is also possible 
that the solution is characterized by structural properties (at 
least for some fxixoit),yo{t)), fy{xoit),yo{t))) which we 
plan to investigate in followup work. 


numerical solution. Ongoing work focuses on further exploring 

this case and on extensions to multiple mobile source nodes. 
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VI. Conclusions and future work 

We have redehned the lifetime for WSNs with a mobile 
source node to be the time until the source node runs out 
of energy. When the mobile node’s trajectory is unknown in 
advance, we have shown that optimal routing vectors can be 
evaluated as solutions of a sequence of NLPs as the source 
node trajectory evolves. When the mobile node’s trajectory is 
known in advance, we have limited ourselves to formulating 
an optimal control problem which requires an explicit off-line 







